Bi-GRU Relation Extraction Model Based on Keywords Attention

نویسندگان

چکیده

Abstract Relational extraction plays an important role in the field of natural language processing to predict semantic relationships between entities a sentence. Currently, most models have typically utilized tools capture high-level features with attention mechanism mitigate adverse effects noise sentences for prediction results. However, task relational classification, these mechanisms do not take full advantage information some keywords which on expressions sentences. Therefore, we propose novel relation model based keywords, named Relation Extraction Based Keywords Attention (REKA). In particular, proposed makes use bi-directional GRU (Bi-GRU) reduce computation, obtain representation sentences, and extracts prior knowledge entity pair without any NLP tools. Besides calculation entity-pair similarity, REKA also utilizes linear-chain conditional random (CRF) combining features, similarity its hidden vectors, weight resulting from marginal distribution each word. Experiments demonstrate that approach can utilize incorporating expression semantics assistance achieve better performance than traditional methods.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

mortality forecasting based on lee-carter model

over the past decades a number of approaches have been applied for forecasting mortality. in 1992, a new method for long-run forecast of the level and age pattern of mortality was published by lee and carter. this method was welcomed by many authors so it was extended through a wider class of generalized, parametric and nonlinear model. this model represents one of the most influential recent d...

15 صفحه اول

YNU-HPCC at IJCNLP-2017 Task 4: Attention-based Bi-directional GRU Model for Customer Feedback Analysis Task of English

This paper describes our submission to IJCNLP 2017 shared task 4, for predicting the tags of unseen customer feedback sentences, such as comments, complaints, bugs, requests, and meaningless and undetermined statements. With the use of a neural network, a large number of deep learning methods have been developed, which perform very well on text classification. Our ensemble classification model ...

متن کامل

A GRU-Gated Attention Model for Neural Machine Translation

Neural machine translation (NMT) heavily relies on an attention network to produce a context vector for each target word prediction. In practice, we find that context vectors for different target words are quite similar to one another and therefore are insufficient in discriminatively predicting target words. The reason for this might be that context vectors produced by the vanilla attention ne...

متن کامل

A Hierarchical Contextual Attention-based GRU Network for Sequential Recommendation

Sequential recommendation is one of fundamental tasks for Web applications. Previous methods are mostly based on Markov chains with a strong Markov assumption. Recently, recurrent neural networks (RNNs) are getting more and more popular and has demonstrated its effectiveness in many tasks. The last hidden state is usually applied as the sequence’s representation to make recommendation. Benefit ...

متن کامل

Attention-Based Convolutional Neural Network for Semantic Relation Extraction

Nowadays, neural networks play an important role in the task of relation classification. In this paper, we propose a novel attention-based convolutional neural network architecture for this task. Our model makes full use of word embedding, part-of-speech tag embedding and position embedding information. Word level attention mechanism is able to better determine which parts of the sentence are m...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Data intelligence

سال: 2022

ISSN: ['2096-7004', '2641-435X']

DOI: https://doi.org/10.1162/dint_a_00147